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Abstract 

If A = 2y 2 , then A z is a compact abelian group. A linear cellular automaton is 

a shift-commuting endomorphism of A z . If [i is a probability measure on A z , then 
<1> asymptotically randomizes fi if <& J fj, converges to the Haar measure as j—*oo, 
for j in a subset of Cesaro density one. Via counterexamples, we show that nonzero 
entropy of [i is neither necessary nor sufficient for asymptotic randomization. 

If A = Z/2 (with discrete topology), then A z (with Tychonoff topology) is a compact abelian 
group. Let cr : A z — >A Z be the shift map (ie. cr(a) = [a' z \ ze %], where a' z = a z _i, \/z G Z). 
A linear cellular automaton (LCA) is a topological group endomorphism $ : — >A Z 
that commutes with cr. Let A4(A Z ) be the set of Borel probability measures on A z , and 
let 77 G .M(.A Z ) be the Haar measure. If /i G Ai(A z ), we say that $ asymptotically 
randomizes /x if there is subset JcNof Cesaro density one so that wk*— lim = rj. 

LCA randomize a broad class of probability measures, including Bernoulli measures, 
Markov chains, and Markov random fields 0, f|, One of the common factors 

in all these cases is positive entropy. Conversely, randomization is impossible for many 
zero-entropy measures, such as quasiperiodic or rank one systems 0. 

Is positive entropy a necessary /sufficient condition for asymptotic randomization? We 
will refute both possibilities, by constructing, in §[l], a zero-entropy measure which asymp- 
totically randomizes, and in §|2], a positive entropy, ergodic measure which doesn't. 



Preliminaries: If $ is any LCA on A z , then there is a finite set V C Z so that $ can 
be written as the polynomial of shifts $ = X^eY* 7 ""- This means, for any a G A z , that 
$(a) z = ^2 veY a z+v for all zGZ, The advantage of this notation is that composition of LCA 
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Figure 1: The construction of random sequence a°°, and the approximation of a as a random 
translate of a°°. 



corresponds to multiplication of their respective polynomials. We can thus apply methods 
from polynomial algebra over finite fields. 

In particular, we can compute binomial coefficients, mod 2, as follows: If n £ N, let 
{nW}^ be the the binary representation of n, so that n = YHiLo 71 ^^' '■ H N EN, then 
write "n < N" if < N® for all % E [O..oo). Then Lucas Theorem ]§ states: 

N\ f 1 if n < N , , , 

(mod 2) 



if n it N 



The simplest nontrivial LCA is the Ledrappier automaton $ = 1 + a. Let L(iV) 
{f 6N; £ iV}. A consequence of Lucas theorem is that 



£€L(A0 

Thus, the 'geometry' of L (AT), as a subset of N, determines the dynamics of <& N . 



1 A Zero-Entropy measure that Randomizes 

Let a = 7^75. For any n E N, let p n be the probability distribution on A = Z/ 2 so that 

p n {l} = a n and p n {0} = 1 - a n (1) 

For each n E N, we will construct a random sequence a n 6 A z as follows. First, define 
a = [...0000...]. Now, suppose, inductively, that we have a n . Let p\ , p% , ■ ■ ■ , p%n be 
independent A- valued random variables with distribution p n . Let p n E A 1, be the random, 
2 n+1 -periodic sequence 

P n = [...,o 1 ^^,^, P ™,...,^„,p^^ 

2" 2" 
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and define a n+1 = a n + p n . 

on 

Let \x n G A4(A Z ) be the distribution of a", and let fx n = — > cr l (fi n ) be the stationary 

2 n ^ — ' 

i=i 

average of \i n . Finally, let \i = wk*— lim fj, n . 

n^roo 

oo 

Let fiao be the probability distribution of the random sequence a°° = p n (see Figure 

n=l 

0). Then, /^oo = wk*— lim // n , and loosely speaking, fi is the 'cr-ergodic average' of fj,^. 

Hence, if a is a /i-random sequence, we can think of a as obtained by shifting a°° by some 
random amount. 

One way to think of a°° IS cLS cL 'randomly generated Toplitz sequence'. Another way is 
to imagine a°° as generated by a process of 'duplication with error'. Let w° = [0] be a word 
of length 1. Suppose, inductively, that we have w n = [wiW2 ■ ■ ■ u>2»]- Let w n = [W1W2 ■ ■ ■ w n ] 
be an 'imperfect copy' of w n : for each m G [1..2 n ], w m = w m + p m , where Pi,p% ■ ■ ■ ,p% n 
are the independent p n -distributed variables from before, which act as 'copying errors'. Let 
w rt+1 = w™w n . Then a°° is the limit of w n as n-^oo. 

If v is a probability measure on {0, 1}, then let 

H(v) = -z/{0}log(z/{0}) - v{l}\og{v{\}) 
be the entropy of v. If b is a //-random variable, and x '■ A — ^ is some function, then let 

K[x(b)} = v{0} X (0) + u{l} X (l) 
be the expected value of xip). 

Lemma 1 Let a G A z be a fi-random sequence, and fix n G N. Then for all m G [1..2 n ], 
«m+2™ = dm + d m , where di,...,d 2 ™ are independent random variables with distributions 
5%, . . . , #2», such that, for all m, 

(i) Ifn>5,then a n < 5 m {l} < 8a n ; 

(ii) If n> 20, then H(5 m ) < 2n-a n . 

Proof: By construction, there is some k G Z so that a looks like er fc (a°°) in a neighbourhood 
around 0. To be precise, a m = a^ +m for all m G [1..2 n+1 ]. 

For example, consider Figure [I], and let n = 2, so that 2 n = 4; suppose k = 6. Thus, 

[oi, 02, . . . , a&] = [a£°, a^°, . . . , a^] 
Thus, d\ = as — a± = — = p\ — p\ = p\ + p\- Similarly, for any m G [1..2 n ], 

d m = &m+2 n ~ &m = Clk+m+2 n ~ a k+m = Pm Pm\ + • • • + Pmj 
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where n = uq < n\ < . . . < rij (and depend on m and k), and where pnij has distribution 



For all j G [0..J], let Pj = Prob ^ is odd j . Thus, 



Ml} = Po = Pn{0} • Pi + Pn {l} ■ (1 - Pi) = (1 - a n ) ■ Pi + a n ■ (1 - Pi) 

= a n + (1 - 2« n ) • Pi > a n , (because n > 5, so a n < §, so 1 - 2a n > 0.) 

This holds for any G Z. Average over all to get the lower bound in (i). 
Also, for any j G [1.. J), we have 

Pi = (l-a n 0-P i+1 + ^-(l-P i+1 ) = P i+1 + (l-2P i+1 )a^ < P i+ i + a% 
and Pj = a nj . Hence, inductively, 

00 

S m {l} = P < a n ° + a ni + ... + a nj < V a* = a n ° < 8a n °. 

z — ' 1 — a 

i=n 

Again, this holds for any fceZ; average over all k to get the upper bound in (i). 

Proof of (ii): If < |, then H(v) decreases as ^{1} decreases. If n > 20, then 
Part (i) says 5 m {l} < 8a n = 2 3 " n / 5 < |; hence, 

H{8 m ) < -8a n log 2 (8a n ) - (1 - 8a n ) log 2 (1 - 8a n ) 

(a) 

< 8a n (- - 3) + (1 - 8a") ■ 2~S? = 8 (| - 1 - 16a n ) ■ a n 



< -n ■ a n < 2n ■ a n , 
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where (a) is because, for small e, log(l — e) « — e, thus, — log(l — e) < 2e. □ 



Lemma 2 = 0. 

Proof: Suppose a G *4. z is a /i-random sequence. Fix n > 20; we want to compute 

the conditional entropy H (a| |a| ). By Lemma |l](ii), we know that, for all 

m G [1..2 n ], a 2 « +m = a m + d m , where di,d 2 , . . . , d 2 n are independent random variables 
with distributions 61, ... , 8 2 n, such that H(S m ) < 2na n . Thus, 



(2™..2"+ 1 ] 



a| [12n] ) = H{d x ,d 2 ,...,d 2n ) = ^P(U < 2"-2n« n = 2n\2a) n . 



m=l 
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Thus, for any iV > 20, 

AT-l N-l 



h(bl\, m a| r , m ) = V#(ai a|. ,) < V 2n ■ (2a) n 

V I [1-2^] |[1..2 20 ]/ Z— t \ \(2 n ..2 n + 1 ] |[l.-2"]/ V 7 

n=20 " n=20 

< 2N ■ (2a) 20 ( 2 «) n = 2iV-(2a) 2 ° l j < cN ■ (2a) N , 

n=0 

where c is a constant. Thus, if H Q = ^a|^ 220 ] )> then 

H {%.^) = H {%.,^\%.^ ] ) + Ho < cN.(2a) N + H . 

HenC6 ' h M = jtL ^ H {%i..m ] ) = & 2^^( a |[i.. 2 -]) 
= hm CiV " (2 f + g ° < c Inn = 0, 

because a < 1. □ 

is a compact abelian group; let A z be its group of characters. The only nontrivial 
character of A = Z/ 2 is the map £ : .4 — ^{±1} defined: 8(a) = (~l) a . If 1 ^ X G *4. z , 
then there is a finite subset K C Z so that, for any a G *4. z , x( a ) = J^£( fl fc)- For all 

keK 

k G K, define Xfc : A z — ^{±1} by Xfc(a) = £(a k ). We define rank [%] = card [K], and 

diam [x] = max(K) — min(K) + 1, and write "x — §Qxk- 

fceK 

Lemma 3 Let $ = 1 + <x. T/ien $ asymptotically randomizes \l. 

Proof: As in the proof of || Theorem 12], it is sufficient to prove that, for any 1 A z , 

there is a set J C N of density one so that lim u, x) — 0- Let x — DOXfc- 

fceK 

Let iV > log 2 (diam [x]), an d assume without loss of generality that K C [0.-2^] . 

Let n G N be some large integer with binary expansion {n^}j =0 , where I = [log 2 (rz)J . 
For generic n G N (ie. for a set of n of Cesaro density 1), we can find J G N so that 

(Gl) N + 2< J <I/2; and (G2) n (J ~ 2) = n {J - l) = 0. 

J-3 J 

Thus, n = uq + 2 J ni, where no = '^^n^2 : ' and ri\ = ^jn^2 3 '~ J . 

i=o i=J 



Thus, L(n) = L(n ) + 2 J -L(ni). Now, let £ = (£) x ° *r . Then 

^GL(no) 



teL(n) e 1 eh(n 1 ) ^oeL(no) ^ieL(m) 

is a 'product of translates' of £ . These translates do not overlap, because 

diam[£ ] < diam[x]+n < 2 N + 2 J ~ 2 < by (G1) 2 J ~ 2 + 2 J ~ 2 < 2 J . 
Let I = {j G [J--I] ! — !}■ Let e > be small; then for generic n 6 N, we can assume 
(G3) card [I] > |(J-J)-e. 

Since a = ^75, we can find such that A < (3 < 2 1 / 4 . Thus, if M = card [I] - 1, then 

M > by(G 3) i(/-J)-e-l > by(G1) > log 2 (/3)/, (2) 

because log 2 (/3) < | and J is large, while e is small. 

Suppose I = {ix < %i < . . . < im+i = !}■ For each m G [0..M], define £ m+i = 
£ m ® where L = 2*™. Thus, x^" = £m+i- 

Let r = rank [£ ]. Then for all m G [1..M + 1], rank [£ m ] = 2 m • r. In particular, define 
R = rank[£ M ] = 2 M • r > by (2) /? 7 • r. (3) 

Thus, £ M = 0^, where X C Z is a subset with card [X] = R. Thus, if a G A z is a 
//-random sequence, then 

^A/+i( a ) = ^( a ) ■ ($m ° °" 2/ ( a )) = n^^''-''^ - 2/) = + a ^+2 j ) = n^^) 

xGX a;GX xGX 

where {d x } x ^x are independent random variables as in Lemma [l]. Let d x have distribution 
8 X ; then <5 X {1} > a 1 , by Lemma 0(i). Thus, 

E 5x [^(4)] = 4{0}-4{l} = 1-2^{1} < 1-2 -a 7 ~' ! 



Thus, = E 



nu4) 



II E ^ & (da,)] < 

xGX 



2a- 7 

2a" 7 - 1 
2a- 1 
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Thus, log 



< R ■ 
-R 



log (2a- 1 - 1) - log(2«- r 
-fir 



< 



(*) 



-R ■ log' (2a- 7 ) 



< 



2a- 1 ^ by ( & 2or J 
(*) is because log is a decreasing function. But f3 > K so a/5 > 1. Thus, if J C N is the set 
of all n G N satisfying the generic hypotheses (G1-G3), then lim log (/i, x ° = 

J9n— >oo 

— - lim (a/3) 1 = -oo. Hence lim x°® n )\ = 0. □ 

2 /— >oo J9n— >oo 



"2 M)7 ' 



2 A nonzero-entropy measure that doesn't randomize 

Let Q = 2 k for some k > 0. Treat ^4 field, and ^t 1 -^ cLS cL Q- dimensional vector 
space over A. Let R < Q, and let £> C .A' 1 "^ be an i?-dimensional vector subspace. Define 
if) : B z — >A Z as follows: if B G B z , where B = [b^] zeZ and = [6^]?=i, then 



V(B) 



6 (-i) 6 (-i) 



6 (-i) 6 (o) ft (0) 
,Uq , u 1 ,u 2 , 



where ^(B)i = bf ] . Let 03 = image [if>] C -4 Z , with orbit closure X = U?=i°" 9 (®)- 
Lemma 4 Let $ = 1 + <x. T/ien /or any n£N, $ nQ (X) C X. 

Proof: Lucas' theorem implies that $^ = l + cr Q ; We claim that C 03. To see this 
let a = V(B) for some B = [b^] z& G £ z . Then $ Q (a) = a + cr°(a) = ^ (b + <x(b) 
so $ Q (a) G 05 also. Hence, $ Q (X) C X; hence $ nQ (X) C X for all n G N. 



.(o) 6 (i) ,(i) .(1) 

u 1 ,u 2 , ■ ■ ■ , Uq , 



□ 



Let v G M.{B Ij ) be the uniformly distributed Bernoulli measure; let v 
(jl = Ylq=x (jq (^0- Then /i is a cr-ergodic measure, and supp (/i) = X. 



fz/), and let 



Lemma 5 



log 2 (P). 



Proof: Every Q symbols of an element of X corresponds to a single symbol of some 
element of £ z , and h{u) = R ■ log 2 (P). □ 



Lemma 6 $ cannot asymptotically randomize \i. 

Proof: Let \i n = $ n (/i) for all n G N. Lemma f| implies that supp(yU n g) C X for any 
fi£N. Thus, the sequence {/i n }£Li cannot converge to r\ along a set of density one. □ 
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